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(54) Method and device for linking multimedia data 


(57) It is desired to llnl< photo data and video data 


together with thef Irst multimedia data (201 ). The second 


taken by a digital camcorder (200). Therefore, there is 


multimedia data may be stored (206) together with re- 


provided a device and method for linking multimedia da- 


spective linking infomnation (211 ) to the first multimedia 


ta, wherein linking infomnatlon is formed (209) on the 


data on a second recording medium (207). Thus, a cam- 


basis of first and/or second multimedia data. The linking 


era-man while recording is able to set up logo or index 


infomnation is stored (21 0) on a recording medium (202) 


pictures for a video film. 
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Description 

[0001] The present invention relates to a n^iethod and 
device for linking first and second multimedia data. Par- 
ticularly, these first and second multimedia data include 
a video stream and photo pictures. 

Background 

[0002] Many digital camcorders can record video 
films on a tape and photo pictures (or E-video clips) on 
a media-card. The image contents taken In videos and 
photos are usually very correlated and coherent. For ex- 
ample, video and photos might be related in the follow- 
ing aspects: taken in the same time; taken at the same 
place; shot to same objects (persons); shot In a similar 
scene; taken during the same event; taken under the 
same mood or feeling; photo and video are content- 
compensated; photos represent the highlight still con- 
tents of a video etc. Many kinds of new camcorders can 
even record e-video clips on a media card. Such e-vldeo 
clips represent the highlight of a video. E-video clip is 
very a kind of video thumbnail. 
[0003] However, the video films on the tape and the 
photos (or E-video clips) on the media-card are treated 
separately by editing and archiving. Such a procedure 
is illustrated in Fig. 1. A digital camcorder 100 is used 
for recording 101 a video sequence on a canncorder 
mini-tape 102. At a later time the video film is played 
back and edited 103 using a video recorder and a tele- 
vision set 1 04 or a personal computer 1 05. Alternatively, 
the camcorder 100 may record 106 a photo on a cam- 
corder media-card 107, After recording the photo may 
be viewed and edited 1 08 by using a personal computer 
105. While recording, no connection (or relation) is de- 
fined for the recording contents between video and pho- 
to (or e-video clip). Today, editing and customizing the 
relation between recordings on the tape and the media 
card requires an editing process separate from the act 
of recording itself, and this process is also perfomned on 
an equipment different from the recording equipment. 
However, it is impossible for a camera-man while re- 
cording to make use of still pictures (or e-video clips) in 
a media-card in order to set up more attractive features 
for the video contents on a tape. 

Invention 

[0004] I n view of that it is the object of the present in- 
vention to provide a method and an apparatus which al- 
lows linking of two or more different multimedia data. 
[0005] This object is solved by a method for linking 
multimedia data including the steps of providing first and 
second multimedia data, forming linking information on 
the basis of said first and/or second multimedia data, 
and storing said linking information on a first recording 
medium together with said first multimedia data. 
[0006] Furthemnore, according to the present inven- 



tion there is provided a device for recording multimedia 
data including providing means for providing first and 
second multimedia data, linking means connected to 
said providing means for fomning linking information on 

5 the basis of said first and/or second multimedia data, 
and storing means connected to said linking means for 
storing said linking infonnation on a first recording me- 
dium together with said first multimedia data. 
[0007] Preferably, the first and second multimedia da- 

10 ta include video, photo and/or audio data. Thus, it is pos- 
sible to mutually link a video film or video sequences 
with photo pictures. 

[0008] The linking information may include logo or in- 
dex messages for the video film, the photo pictures and/ 

IS or any audio sequences. Such logo message contains 
linking Information from a video on the tape to a picture 
on the media card. The index message contains one or 
more codes of related pictures on the current media 
card. With such logo or Index messages it is possible to 

20 link photo data and video data for example on the basis 
of a photo picture included in these photo data or by a 
video section included in this video data. One can easily 
imagine that a characterizing photo picture facilitates 
the linkage of a plurality of pictures and video films for 

25 the user. 

[0009] Advantageously, the linking infonnation may 
be fomied in real-time while recording the video on the 
video tape. Thus, both is possible, the offline editing of 
logo and index pictures as well as the real time gener- 
ic ation of them. 

[0010] Logo and index messages may be set up and 
recorded both on a video tape and on a picture media- 
card. This technique has the advantages of making an 
easy and fast recording operation possible, of helping 
35 the user to do post-editing and of preventing the user 
from accidently deleting any useful pictures on the mul- 
timedia-card. 

[0011] The pictures may be designed as "logo and in- 
dex", "logo only" and "Index only". Furthermore, some 

40 strategies for recording and playback may be designed 
as "visible" and "invisible", "copy now" and "copy later", 
"playback with logo" and "playback without logo". Addi- 
tionally, an e-video-clip may be used as logo or index 
message. Thus, the present Invention helps to set up a 

45 significant "bridge" between video essence and photo 
essence seperately recorded by a digital camcorder. 
[0012] The logo and Index pictures (metadata) are 
usually not generated directly from video frames. They 
are usually generated by photo shooting before the re- 

50 cording of video contents. 

[0013] In other words, the Easy Video Logo & Index 
Picture Generation System according to the present in- 
vention for a Camcorder makes It possible to let the 
camera-man to set up logo or index pictures (or video 

55 clip) for video while recording. While a logo or index pic- 
ture Is being created, a logo-mark code is written to a 
special track on video tape, or a index-mark code Is writ- 
ten to a special index file in the media-card. The logo 
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pictures (or video clips) can improve a kind of "picture 
in picture" function. The logo picture provides additional 
messages to the recording video, and therefore it makes 
the recording more attractive. The index pk^ture acts as 
a kind of rich media metadata for the video essence. It 
can be utilized to search video essence. 

Drawings 

[0014] Exemplary embodiments of the invention are 
illustrated in the drawings and are explained in more de- 
tail in the following description. In the drawings: 

Fig. 1 shows the procedure of taking videos and 
photos by a digital camcorder of the prior art; 

Fig. 2 shows the principle of taking videos and pho- 
tos by a digital camcorder according to the present 
invention; 

Fig. 3 shows the physical order of a video tape con- 
taining a logo track; 

Fig. 4 shows a first part of the logk^al structure of a 
media card; 

Fig. 5. shows a second part of the logical structure 
of a media card; 

Fig. 6 shows a diagram of the system requirements; 

Fig. 7 shows a diagram of the recording procedures 
of logo and index pictures; 

Fig. 8 shows a diagram of the logo fixing during vid- 
eo playback; 

Fig. 9 shows a first continuation of figure 8; 

Fig. 10 shows a second continuation of figure 8; 

Fig. 1 1 shows a diagram for the procedure of index 
fixing. 

Exemplary embodiments 

[001 5] The principle of taking videos and photos by a 
digital camcorder according to the present invention is 
shown in Fig. 2. Similar to the prior art, a camcorder200 
records 201a video on a mini-tape 202. The recorded 
video may be played back and edited 203 by using a 
video recorder and a televison set 204 or a personal 
computer 205. Additionally the camcorder 200 may 
record 206 photos on a media card 207. The recorded 
photos may be viewed and edited 208 by using the per- 
sonal computer 205. Now, the following steps are pro- 
vided by the present invention. A relation may be creat- 
ed 209 between the video and photo data. Infonnation 



concerning the relation to the photos is written 210 as 
logo-info (see also step 302 of Fig. 6) to the tape 202. 
Similarly information concerning the relation to the video 
recorded on the tape is written 211 as index-info (see 

5 also step 405 of Fig. 6) to the media-card 207. Conse- 
quently, the video may be searched, played and edited 
212 on the personal computer 205 by using the logo- 
info. Additionally, a photo may be searched, played and 
edited 212 on the personal computer 205 by using the 

10 index-info. 

[0016] The prefen^ed system and its implementation 
components are described in the following, wherein the 
description for "logo /index picture" is also valid for "logo 
Aindex e-video clip". 

15 

1 . System Requirements 500 (see Fig. 6) 
[0017] 

20 a) It is necessary to equip a camcorder with a set 
of buttons 501 , which allow to put the camcorder in 
a special "mark Input mode". In the basic embodi- 
ment, a camcorder has an annotation button in a 
central and easy to reach position. In an enhanced 

25 type of camcorder there may be provided an E-vid- 
eo clip playback function. In order to create a logo 
/ index picture for video, special memory space on 
a video tape and on a media-card must be reserved. 

30 b) For the video tape 300 (compare also Fig. 3), a 
special logo track 302 (or logo bytes) for each video 
frame must be reserved on the tape for recording 
the logo-mark code 303. The logo-mark code 303 
contains link messages from the video on the tape 
35 to a picture on the media-card. The logo-mark code 
303 contains a media-card ID 304 and a picture ID 
message 305. The media-card ID message 304 is 
a kind of volume ID, it may be a predefined media- 
card name or number. The picture ID includes the 
40 picture name message. 

Fig. 3 indicates the physical structure of a video 
tape 300. The video tape 300 contains a plurality of 
video frames 301 each fomned by a number of data 
bits. Within the video frame 301 there is provided a 
45 logo track 302 for the logo-info, i.e. the logo marke 
code 303, containing a media-card ID 304 and a pic- 
ture ID 305. Thus, there is a link to a logo picture 
on a specific media card. 

50 c) For media-card 400 (compare also Fig. 4 and 5), 
the index info 405 including a special index file 420, 
a special temporary file 41 0 and a special thumbnail 
directory 430 must be generated in the media-card. 
The index file 420 in the media-card 400 is created 
55 for a recording index-mari< code 421 . The tempo- 
rary file 410 is used to keep temporary index code 
411 for logo/ index picture candidates. The thumb- 
nail directory 430 is set to store all thumbnail pic- 
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tures 431 , which may be used as logo or Index pic- 
tures (see Fig. 4 and 6). 

d) The Index file 420 In the media-card 400 contains 
index-mark codes 421 of all related pictures in the 5 
current media-card as shown In Fig. 6. Whenever a 
picture is set as logo or index to the video, an Index- 
mark code 421 will be created in the index file 420. 
The index-mark code 421 includes all link messag- 
es between pictures on the media-card 400 and vid- io 
eo essence on the tape 300. There are two kinds of 
index-mark codes 421 : 

When a picture Is set as Index picture 422 for 
video, the index-mark code 421 Includes a pic- is 
ture ID 424 and video essence ID message 
423. The picture ID 424 contains a picture 
name 427, directory name 428 and status label 
429 of the related picture. The status label 
shows If the picture is "logo & Index", "logo only" 20 
or "Index only". More about status label will be 
explained in detail in 2(h) and3(cto e). The vid- 
eo essence ID 423 contains video tape ID 425, 
video content start-time and end-time message 
426. The video tape ID 425 may be a prede- 25 
fined tape name or number. 
When a picture Is only set as logo picture 412 
forvideo, the index-markcode421 contains on- 
ly the picture ID 424. In this case, no video es- 
sence ID 423 is needed. See also Fig. 5. 30 

e) The temporary file 410 shown In Fig. 5 contains 
Index codes of all candidate pictures In the current 
media-card 400. When a picture is selected as can- 
didate to create video logo or Index, an index code 35 
(compare 411 of Fig. 6) will be written in the tempo- 
rary file 410. The index code includes a picture ID 
message 424, the picture ID contains picture name 
427, directory name 428 and status label 429 of the 
selected picture. While video recording, camera- 40 
man may select predefined logo or Index candidate 
directly from the candidate file. 

f) The thumbnail directory 430 shown in Fig, 4 con- 
tains all thumbnail pictures, which are used as logo 45 
I index pictures for video. Compared to an original 
picture, a thumbnail picture Is reduced in size so 
that It needs less storage capacity. The thumbnail 
directory 430 has the advantage of protecting 
thumbnail pictures so that they are not affected by so 
normal photo editing. 

g) A special synchronizing playback method is 
needed to build e-video clip logo in video frames as 
Indicated by reference signs 502 in Fig, 6. In this S5 
case, an e-video clip can be treated as a series of 
still pictures. Each picture may be built in video 
frame one by one. 



2. Preparation for Recording 
[0018] 

a) In order to create logo & index pictures for a video 
while recording, a selected picture, which will be 
used as logo or index picture, should be recorded 
before the video is recorded. The picture may be 
taken by camcorder itself, or imported from other 
Instruments. The picture may be saved as nomnal 
camcorder photo format, or as special thumbnail 
format. The thumbnail fomiat is defined specially for 
this application. A thumbnail picture will be saved 
directly in the thumbnail directory 430 of media-card 
400 (see Fig. 4). Both photo fomiatted picture and 
thumbnail picture can be selected as logo / index 
picture. 

In the case of Fig. 4 pictures 1 , 3 and 6 are stored 
as thumbnail pictures with a reduced size in the 
thumbnail directory 430. Consequently, the pictures 
1 , 3 and 6 can be deleted from the picture directo- 
ries 440 and 450. As a result memory capacity can 
be saved. 

b) The index screen of the camcorder may be used 
to select a preferred picture. The picture name 427, 
directory name 428 of the selected picture and a 
status label 429 (see 2(g)) is encoded as an index 
code 421 , which is saved in the temporary file 41 0 
in the media-card 400. A selected picture can be 
Input into the temporary file 41 0 by clicking a button 
of the camcorder. It Is also possible to select the 
picture during video recording by Inputting the pic- 
ture Index number directly. 

c) All selected pictures must be set to "protected" 
status, so that they cannot be deleted erroneously 

d) More than one picture can be selected as logo / 
index candidates picture to be stored in the tempo- 
rary file. While video recording, all candidate pic- 
tures can be browsed through button wheel tuming. 

e) The logo picture format and position on the video 
can be defined before, during or after recording. 
The logo picture can be shrunk or enlarged inside 
the video frame. Furthermore, the logo picture may 
be located at the upper, under, left or right corner. 
It may fill up the whole video frame. 

f) The logo picture may be processed according to 
a predefined effect function. 

g) The selected picture can be defined in three sta- 
tuses: "logo & Index", "logo only" and "index only". 
A status label, which represents the status mes- 
sage, is created as part of the index code in the tem- 
porary file. The "logo & Index" status means that the 
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selected picture is defined both as logo and index 
picture for video. The "logo only" status means that 
the selected picture is defined only as logo picture 
for video, It is innpossible to use this picture as Index 
metadata for video essence. The "index only" status 
means that the selected picture is defined only as 
Index metadata for video essence, it is impossible 
to use it as logo picture for video. The default status 
of a selected picture should be defined as "logo & 
Index". 

h) The temporary file (see 1(e)) contains index 
codes of all logo / index candidate pictures. The In- 
dex code Includes picture name, picture directory 
name and picture status label. The status label can 
represent "logo & Index", "logo only" and "index on- 
ly". The temporary file should be created before vid- 
eo recording. The Index codes in the candidate file 
will be cleared as soon as they are invalid. 

I) A selected picture can be used multiple as logo / 
Index picture. 

3. Recording 600 (see Fig. 7) 

[0019] 

a) White video recording, the camera-man only 
needs to click 601 a button to browse all selected 
pictures from the candidate file in the media-card. 
Through button clicking 601 , the camera-man can 
set a selected picture as logo or Index picture for 
video. If no pre-selected picture exists in the candi- 
date file, the camera-man only needs to click a but- 
ton to browse a list of all pictures of the media-card, 
and turn a wheel to select a picture and set the pic- 
ture as logo or index picture for video. For a selected 
picture the statuses "logo-only" 602, "logo & index" 
603 and "index only" 604 may be chosen. 

b) If a selected picture is set to be logo picture of 
video 605, the logo picture may be set to be visible 
606 or invisible 607 In the camcorder view finder. 

(1 ) When It is visible 606, its position and frame 
size may be adjusted by camera-man. The 
camera-man may choose whether to "copy 
now" 608 to the video tape or "copy later" 609. 
If "copy now" 608 Is selected, the logo picture 
with its position and size in the view finder will 
be embedded in the video contents and be per- 
manently recorded on the video tape. Later the 
logo picture in the video can not be edited or 
deleted any more. In this case, it is not neces- 
sary to create any logo mark on the tape or In- 
dex-mark in the media card 610. If "copy later" 
609 is selected, the logo picture is not recorded 
on the video tape, the picture stays still in the 



media card. It is still possible to edit the logo 
picture later at a post-processing stage. In this 
case, both logo-mark and index-mark are gen- 
erated 61 1 . The logo-mark code is written in the 

5 logo track on the tape, and the index-mark 

code, which contains only picture ID, is written 
in the index file in the media-card. The selected 
picture must be set to "protected". 
(2) When the logo picture is set to be invisible 

^0 607, the logo picture Is not recorded on the vid- 

eo tape, and the logo picture will be edited at 
post-processing stage. In this case, both logo- 
mark and index-mark are generated 611 . The 
logo-mark code is written in the logo track on 

^5 the tape, and the Index-mark code, which con- 

tains only the picture ID, is written in the index 
file in the media-card. The selected picture 
must be set to "protected". 

20 c) If a selected picture is in "logo & index" status 
603, it means that this picture will be set up as both 
logo and index picture for video. In this case, both 
logo-mark and index-mark are generated 611 . The 
logo-mark code is written in the logo track on the 

25 tape, and the index-mark code, which contains the 
picture ID and video essence ID, is written in the 
Index file in the media-card. The logo-mark code 
and Index-mark code are structured as described in 
paragraph 1 . 

30 When a selected picture is set as logo and index 
picture for video, it should be set to "protected". 

In this scenario, the logo picture can be treat- 
ed as described in 2(e). 

35 d) If a selected picture is In "logo only" status 602, 
this picture will be created as logo picture for video. 

In case, the logo picture Is set as "visible" + 
"copy now" 606,608, the logo picture Is recorded on 
the tape, no logo-mark or index-mark code is gen- 

40 erated in this scenario, the related picture In media- 
card does not need to be set protected, and editing 
of this picture does not affect the already created 
log picture. 

In case, the logo picture is set "invisible" 607 
45 or "visible" + "copy later" 606, 609, both logo-mark 
and index-mark must be generated. The logo mari< 
code is written in logo track (or logo bits) on the vid- 
eo tape. The index-mark code, which contains only 
the picture ID, is written in the Index file of the me- 
50 dia-card. 

e) If a selected picture is in "index only" status 604, 
this picture will be created as index picture for video 
612. Later, this picture acts as rich media metadata 
55 for video essence. In this case, only an index-mark 
is generated 613, no logo-mark is necessary. The 
index-mark code, which contains both picture ID 
and video essence ID, is written in index file In me- 
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dia-card. The selected picture In the media-card 
must be set to "protected". 

4. Logo Fixing 700 (see Fig. 8, 9 and 10) 

5 

[0020] 

a) At a post-processing stage, except the case of 3 
(b-1), all In the recording stage generated logo pic- 
tures need to be edited or fixed. io 

b) The logo-mark codes can connect video essenc- 
es and logo pictures. While video playing, the cam- 
corder can automatically read the logo-mark code 
from a logo track on a tape. is 

c) When the user plays or edits the video tape, he 
may choose "playback with logo" 701 or "playback 
without logo" 702. 

When "playback without logo" is chosen the 20 
camcorder will play the video tape nomnally, logo- 
marks on video tape are Ignored 706. 

When "playback with logo" 701 is chosen, the 
camcorder reads all logo-marks. When the cam- 
corder finds a new logo-mark, it will pause the tape 25 
playback at the current video frame, and ask the us- 
er whether to build the logo picture in the video 
frame or not. If the user replies "not built-in", the 
camcorder goes on playing the tape till next new 
logo-mark. If the user replies "built-in", the camcord- so 
er will parse the logo-mark code, tell the user to in- 
sert the correct media-card, read the Index file of 
the media-card, find out the directory of the logo pic- 
ture, took for the logo picture on the media-card and 
build the picture in the video frame. The position and 35 
size of the logo picture viewed in the video frame 
can be arranged and adjusted. The same logo pic- 
ture at the same position and with the same size will 
be built in the following video frames, which contain 
the same logo-mark code. When the camcorder 40 
reads a new logo-mark code, it will repeat the above 
procedure. 

d) When "playback with logo" 701 is chosen, the us- 
er may have three choices to process the logo pic- 45 
ture: 

1 ) The user may record the logo picture pemna- 
nently 703 in the video frame at the desired po- 
sition with the desired size as shown in Fig. 9. so 
Afterwards, the camcorder will check the index 
file and find out If this picture Is still locked by 
other Index mark. 

If the picture is not locked by another In- 
dex mark 707 and it has "logo only" status 708 S5 
in the current index mark, the "protected" status 
of the picture will be cleared 709. Its index mark 
in index file will be cleared too. From now on, 



the connection between this pk^ture and video 
is cut. The picture is free. 

If the picture is not locked by another in- 
dex mark 707 and it has "logo & index" status 
71 0 in the current index mark, the "protected" 
status of this picture will not be cleared, but its 
status label In the current Index mark wilt be 
modified as "Index only" 71 1 . From now on, this 
picture will act as pure index picture. 

If the picture is locked by another index 
mark 712 and it has "logo only" status 713 in 
the cun^ent Index mark, the protected mark of 
the picture will not be cleared 71 4. But, the cur- 
rent Index mark in index file will be cleared. 

If the picture Is locked by another Index 
mark 712 and it has "logo & Index" status 715 
in current Index mark, the "protected" status of 
this picture will not be cleared, but Its status la- 
bel in the current index mark will be modified 
as "index only" 716. From now on, this picture 
will act as Index picture for the cun^ent video 
clip. 

2) The user does not want to record the logo 
picture in the video frame at present 704. The 
user, however, may let the camcorder generate 
a thumbnail picture based on the logo picture 
704, as shown in Fig. 10. The thumbnail picture 
will replace the original logo picture and act as 
logo picture for video 717. The thumbnail pic- 
ture only needs less storage space, and the 
original logo picture will be free from current 
connection. The thumbnail picture will be saved 
in the thumbnail directory (see 1 .(c) and (f))in 
the media-card with the same file name as the 
original logo picture. Later, the thumbnail pic- 
ture will be used as the only logo picture for vid- 
eo. 

If the original logo picture is not locked by 
other index mark 71 9 and it has "logo only" sta- 
tus 720 in the current index mark, the "protect- 
ed" status of the picture will be cleared 721 , Its 
directory name in current Index mark will be 
modified to the name of the thumbnail directory. 
The thumbnail directory name In cun^ent index 
mark will automatically lead the camcorder to 
read the thumbnail picture in thumbnail direc- 
tory as the logo picture. The connection be- 
tween original logo picture and video is cut. The 
original picture is free. 

If the original logo picture is not locked by 
other Index mark 719 and It has "logo & Index" 
status 722 In current Index mark, the "protect- 
ed" status of the picture will be cleared 723. Its 
directory name in the cun^ent Index mark will be 
modified to that of the thumbnail directory. The 
thumbnail picture in the thumbnail directory will 
act as new logo & Index picture for video. The 
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connection between original logo & index pic- 
ture and video is cut. The original picture is free. 

If the original logo picture is locked by an- 
other index mark 724 and It has "logo only" sta- 
tus 725 in cun^ent index mark, the "protected" 5 
status of the picture will not be cleared 726, Its 
directory name in current index mark will be 
modified to thethumbnail directory. This thumb- 
nail directory in the current index mark will au- 
tomatically lead the camcorder to read the io 
thumbnail picture in thumbnail directory as the 
logo picture. The connection between original 
logo picture and cun^ent video clip is cut. 

If the original logo picture is locked by an- 
other index mark and It has "logo & index" sta- is 
tus 727 in cun-ent index mark, the "protected" 
status of the picture will not be cleared 728. Its 
directory name in curent index mark will be 
modified to the thumbnail directory. The thumb- 
nail picture in the thumbnail directory will act as 20 
new logo & index picture forvideo. The connec- 
tion between original logo & index picture and 
current video clip is cut. 

3) The logo picture will not be recorded to video 25 
frame 705 at this moment. Nothing changes 
729. 

e) The user can simply replace the original logo pic- 
ture by another picture, by exchanging their file 30 
names (and modifying the directory name in index- 
maric code, if they are not located in the same di- 
rectory). 

f) When the video on tape is cleared, the camcorder 35 
will promote the user to insert the related media- 
card, and clear all related index marks from the in- 
dex file in the media-card, and clear the "protected" 
status of all related pictures. 

40 

5. Index Fixing 800 (see Fig. 11) 
[0021] 

a) Index-mark codes can link index pictures to video 45 
essences. The user can use an index picture to 
search video essences. Furthermore, the user can 
use an index picture to summary video contents, 
which are linked to the same index picture. The 
camcorder can automatically read Index-mark so 
codes in an Index file of a media-card. 

b) The user can play video essences through "click- 
ing" an index picture. Furthemriore, the user can use 
index pictures to edit video contents. ss 

c) The user may use the original picture as index 
picture 801 so that no further actions is necessary 



802, and the user may also generate a thumbnail 
picture based on the original one and use the 
thumbnail picture as new index picture 803. The 
thumbnail picture is saved in thethumbnail directory 
and it has the same name as that of the original pic- 
ture. 

If the picture is not locked by another index 
mark 804 and it has "Index only" status 805 in cur- 
rent index mark, the "protected" status of the picture 
will be cleared 806. The directory name in current 
index marie will be modified to the thumbnail direc- 
tory name. The connection between the original pic- 
ture and video essence is cut. The original picture 
is free. 

If the picture Is not locked by another index 
mark 804 and it has "logo & index" status 807 in the 
current Index mark, the user can choose between 
"thumbnail as logo too" 808 and thumbnail not as 
logo" 809: 

When user chooses "thumbnail as logo too" 

808, the "protected" status of the picture will be 
cleared 810. The directory name in current in- 
dex mark will be modified to that of the thumb- 
nail directory name. The connection between 
the original picture and video essence is cut. 
The original picture is free. The thumbnail acts 
as both logo and index picture. 

When the user chooses "thumbnail not as logo" 

809, the "protected" status of the original pic- 
ture will not be cleared, but its status label in 
the current index mari^ will be modified as "logo 
only" 811 . From now on, this picture will act as 
pure logo picture. In this scenario, a new index 
mari< with "index only" status label, which points 
to the same video essence as that of the origi- 
nal index picture, must be created for the 
thumbnail picture, so that the user can use the 
thumbnail as index picture. 

If the picture is locked by another index mark 
812 and it has "index only" status 813 in current in- 
dex mari<, the "protected" mari< of the picture will 
not be cleared 814. The directory name In the cur- 
rent index mark will be modified to the thumbnail 
directory name. The connection between the origi- 
nal picture and current video essence is cut. 

If the picture is locked by another index mark 
812 and it has "logo & index" status 815 in current 
index mari<, the "protected" status of this picture will 
not be cleared. In this case, the user may choose 
between "thumbnail as logo too" 816 and "thumb- 
nail not as logo" 817: When user chooses "thumb- 
nail as logo too" 816, the directory name in the cur- 
rent index mark will be modified to the thumbnail 
directory name. The connection between the origi- 
nal picture and current video essence is cut 818. 
When the user chooses "thumbnail not as logo" 
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817, the status label in the current index mark will 
be modified as "logo only" 819. From now on, this 
picture will act as pure logo picture. In this scenario, 
a new index mark with "index only" status, which 
points to the same video essence as that of the orig- 
inal index picture, must be created for the thumbnail 
picture, so that the user can use it as index picture. 

6. Application Examples 

Scenario 1 : 

[0022] While camera-man is shooting a video scene 
or object, he is used to explain something about the 
scene or object His votee will be recorded with the video 
content together. In this case, the camera-man can only 
be heard, not be seen. Usually, it is desired to hear his 
voice and see his face at the same time, just like that in 
TV-news program, while talking to a journalist through 
phone call, a photo of the journalist will be shown as 
logo picture in the display. With the help of this invention, 
the camera-man makes himself to be visible in video 
scene too. At first, the camera-man takes a photo or an 
e-video clip of himself. Then, while video recording, he 
set this photo or e-video clip as logo picture to the video 
content. 

Scenario 2: 

[0023] Usually, photos and e-vldeo clips are highlight 
contents of videos. They can be used as logo labels to 
summary video contents, or provide additional visual 
messages to video contents. For example, one may 
take a photo of Eiffel-Tower and use this photo as logo 
image for all video contents, which are recorded in Paris, 
or using Brandenburger-Tor as logo for all video taken 
in Beriin. If an e-video clip is created as logo to video, it 
provides a kind of simulated "picture in picture" effect. 

Scenario 3: 

[0024] By using recorded index pictures, the camera- 
man can search video contents quickly and effectively. 
They can help the user to edit videos efficiently. 

Scenario 4: 

[0025] By using this invention, one can generate rich 
media metadata for video essence. Such rich metadata 
will be used widely In the future. 



Claims 

1. Method for linking multimedia data including the 
steps of 

providing first and second multimedia data, wherein 
said first and second multimedia data comprise vid* 



eo, photo and/or audio data; 
forming linking Information (209) on the basis of 
said first and/or second multimedia data; and 
storing said linking infomiatlon (210) on a first re- 
5 cording medium (202) together with said first multi- 
media data (201). 

2. Method according to claim 1 , wherein said linking 
Information includes logo (302) or index messages 

10 (405) for video or photo data, respectively. 

3. Method according to claim 1 or 2, wherein said pho- 
to data and said video data are linked by a photo 
pbture included in said photo data and/or a video 

15 section included in said video data. 

4. Methodaccordingtooneoftheclaimsl to3, where- 
in said fonming (209) of linking infonnation is per- 
formed in real time while data recording. 

20 

5. Method according to one of the claims 1 to 4, where- 
in said fonning of linking information includes edit- 
ing of said linking information. 

25 6. Method according to one of the claims 1 to 5, further 
including the step of storing said linking information 
(21 1 ) on a second recording medium (207) together 
with said second multimedia data (206). 

30 7, Method according to one of the claims 1 to 6, where- 
in said first recording medium (202) and/or said sec- 
ond recording medium (207) is a tape, optical disc, 
hard disc or media-card. 

35 8. Device for recording multimedia data including 

providing means for providing first and second mul- 
timedia data, wherein said first and second multi- 
media data comprise video, photo and/or audio da- 
ta; 

40 linking means connected too said providing means 
for fomning linking information (209) on the basis of 
said first and/or second multimedia data; and 
storing means connected to said linking means for 
storing said linking information (210) on a first re- 

45 cording medium (202) together with said first multi- 
media data (201). 

9. Device according to claim 8, wherein said linking 
infomiatlon Includes logo (302) or index messages 

50 (405) for video or photo data, respectively. 

10. Device according to claim 8 or 9, wherein said photo 
data and said video data are linked by a photo pic- 
ture included in said photo data and/or a video sec- 

55 tion included in said video data. 

11. Device according to one of the claims 8 to 10, 
wherein said fomning (209) of linking infonnation by 
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said linking means is performable in real time while 
data recording. 

12. Device according to one of the claims 8 to 11, 
wherein said linking means includes editing means 5 
for editing said linking information. 

13. Device according to one of the claims 8 to 12, fur- 
ther including additional storing means for storing 
said linking infomnation (21 1 ) on a second recording io 
medium (207) together with said second multimedia 
data (206). 

14. Device according to one of the claims 8 to 13, 
wherein said first recording medium (202) and/or ^5 
said second recording medium (207) is a tape, op- 
tical disc, hard disc or media-card. 

15. Camcorder (200) including a device according to 
one of the claims 9 to 1 4. 20 
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